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(54) Electiwlc waiennark Inserting apparatus capalile of inserting dectionlc waieimarfc Into tv 
Image data in real time, and electronic iwatermark inserUng method 



(57) Tb protect 0C3pynSlit8, eloclrani'c viatermarWng 
information i$ Ineerted or embedded into still or moving 
image data by an electronic watermark inserting eppa- 
ratus with a eimple circuit arrangement. In tlie electronic 
walarmaric inserting apparatue. Image data is converted 
into dvital image data by an input drcurt (1 1), the con- 
verted data ia divided into e plurality of blocKs on a 
Gcreen by a block dividing unit (12), and the divided data 
is fitlered by a BPF filter (13). Subsequently, the fre- 
quency characteristic of the image data is measured tor 
every block by a spectrum meaeuring unit (14) while 
lieeping the image data in a temporal region. An ampli- 
tude of the input image data is measured for every block 



to determine for every block a mixing ratio cf the image 
data to electronic watermarking Information on the 
t>a6is of the strength of or change in the amplitude 
measured for each block. Based on the obftained ratk}, 
an electronic watermark mixing unit (1 6) Inserts an elec- 
tn^nic watermark Into the image data. TTie invention 
eliminates the need for discrete cosine conversion, in 
which time series data is converted inlo data of a spatial 
frequency region, and for the inverse discrete cosine 
conversion thereof. Thus, the electronic watemiark 
inserting apparatus is reduced in drcuit scale and sim- 
plified. 
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Desert ption 

RAnKQRQUND nF THE INVENTTION 

1. Field of the Invention 

[0001 ] The lyesent inverrtion generally reletas to an 
electronic watermark inserting apparatus and a method 
thereof. More Gpedfically. the present invention te 
directed to an electronic watermark inserting apparatus 
and a method capable of inserting arbitrary eiectroroc 
watermarking infbrmalion into input image data such as 
a stai Image and/or a moving ptcture In real time. 

2. Description of the Related Art 

[0002] WMenmarking techniques are presently and 
greatly expected in order to protect copyrights about 
elactronically-proGessed data of audio Information, 
video infonnation, and images. Eledronro watermarigng 
infonmaton is inserted into image data> which can be 
haitJly obsen^ by any persons, so as not to deterio- 
rate image quality of superirrposad image data^ 
[0003] Tbese waterniarWng techniques are known 
fromp for instance. Japanese Pttem Application Laid- 
open Na Hei 10-155151. TTiat is. this patent application 
describes the electronic watemf«rk inserting apparalus 
lor Inserting the electronic watermark into the compres- 
sion^oded Image data. Fia 5 is a block diagram for 
indicating the image data processing apparatus con- 
taining an electronic watermark Inserting apparatus 20 
proposed in the above-desorlbed Japanese patent 
appiicatioa The data processing apparatus 20 is com- 
prised of an Input circuit 21 for inputting the original 
image data, a discrete cosine converter 22 for convert- 
ing the original image data of a real spatial regwn (tem- 
poral region) into the original image data of the spatial 
frequency region, and an electronic watermark mixef 23 
Ibr errtsedding the aibitrary electronic watermarking 
Lnfiormation saved in an electronic watermark memory 
24 into the featured portion of the converted image. This 
image data processing apparatus further comprises an 
inverse discrete cosine converter 25 fbr inverse-con- 
vertng the image data of a spatial frequency region, 
into which the electronic watermarking information has 
been embedded, into the original image data, and an 
output drcurt 26 for outputting the inverse-converted 
Image data. The image data processing apparaitus out- 
puts the reproduction data that constitutes the digital 
image data from the output circuit 26. 
[0004] An electronic watermarking Information 
detecting apparatus indcated in FIGL 6 Is capable of 
detecting whether or not the electronic watermark is 
Inserted into the arbltrov image data. This electronfo 
watermarking information detecting apparatus is com- 
prised of an input circuit 31 for Input^ng the image data 
to be detected, a discrete cosine converter 32 for con- 
verting this input image data into the image data of the 



spatial frequency region, a relative relationship detector 
33 for detecting the relative relationship between the 
converted data of the spadai frequency region and the 
electronk: watermarking information stored in an elec- 

5 tronic watermark memory 34, and a display unit 35 for 
displaying thereon the detection results. 
[0005] Oeneratly speaking, in a data processing 
apparatus containing an electronic watermark inserting 
apparatus, original image data is subdivided into a plu- 

10 rality of blocks on a display screen, sach of whfoh con- 
sists of a certain number of pixels in longitudinal and 
lateral cfirections. Also, the original image data is con- 
verted Into Image data of a spatial frequency region by 
way of the discrete cosine conversion with respect to 

fs each of these subdivided laiockB. In the spat^ fre- 
quency region, a mixing ratio corresponding to a 
strength of a signal is produced, and then artDitrary elec- 
tronic watermarking information previously stored in an 
electronic watermaric inserting apparatus is superim- 

so posed on the entsred original image data. Thereafter, 
the image data is compressed In such a manner that the 
image on which the electronic watermarking information 
is superimposed is quantized to be coded in variable 
length coding. Then, the oonpressed imago data with 

86 the electronic walennarking infomiation is transmitted. 
10008] In the abcve-sMplained conventional elec- 
tronic watermaric Inserting apparatus, the entered 
image data of the temporal re^ is converted into the 
image data of the spatial frequency regfon. and this con- 
so verted input image data of the spatial frequency regfon 
is superimposed with the aibitrary etectronio woter- 
maridng mibrmatfon. and thereafter, the supernrfxised 
image data of the spatial frequency region is inverse- 
convened into the imago data of the temporal region. In 

$6 this case, in order to superimpose the input image data 
with the electronic watermarking information at a high 
speedi since both the discrete codne converting circuit 
and the inverse discrete cosine converting circuit are 
required, the entire circuit scale is Increased. Thus, 

40 there is a problem of drcuit serein the electronic water- 
mark inserting apparatus. 

(POOT] For instance, a discrete cosine converting 
operatfon corresponds to such a repetitive calculation 
that a multiplicatfon and an additk)n are contbined with 

4S each other. 1b execute the disciete cosine conversfon 
once, a total number of required multiplfoations is (total 
data number of block x \0Q2 total data nuFTtwr)^. A sim- 
ilar cafoulatfon is required to execute an invense discrete 
cosine converting operation. Assuming now that a total 

so numt>er of longitudinaiyiateral pbmls within 1 blOGk is 
equal to 8 8. Such a calculaiion nvist be carried cut 576 
times per block 

[0008] In this case, fbr example, a telmsion screen 
of a televisfon receiver with employment of the NT&C 
$8 TV system Is constituted by 720 pixele x 480 pixels, and 
1 block has 8 columns x 8 rows. Accordingly, 1 saeen le 
constructed of 5.400 blocks. As a result in the case that 
electronic watermarking information is embedded Into 
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input image data of the tJTSC TV system, fri© discrete 
cosine converting operation is carried out 3,110.400 
{namely. 5.400 x 576) times. Similarly, the Inveree dis- 
crete coeine converting operation must be carried out 
3,110.400 limes. In this NTSC television system, in 5 
order to display 1 frame of Image, since the following 
procesB operations shodd be carried out within 16 milli- 
seconds, the resulting circuit scale required to errted 
the electronic wolermarlcng Information in real time is 
increased. In the processing operations, the above- ^0 
explained discrete cosine converting/irwerse-dlscr^e 
cosine converting operations are perfbrmed, the 
sfrength of the signal within the spatial frequency regton 
is calculated, and the electronic watermarldng informa- 
tion is superimposed on the input Image data. is 

SUMMARY OF THE IMVgNTIQN 

[0009] The preeem Invention has been made in 
view of tfie above, and therefore, an object of the ^ 
present invention is to provide a sinvrfe electronic water- 
mark inserting apparatus capable of inserting etectronlc 
watermarking information into Input image data of a tel- 
evision receiver and the like, and uncomplicated in cir- 
cuit arrangement 

{pOlO] To achieve the above-explained ol^ect. 
according to a first aspect of the present {rwentk>n» there 
is provided an electronic watermark inserting apparatus 
for embedding arbitrary eiedronic watermariong irtor- 
maklon into a still image or a moving picture, character- so 
izedbyconrpriaing: 

a t3lock dividing circuit ftir dividing input image data 
into a plurality of pixel blocks on a display screen, 
the blocs sectioning the screen in unit of a certain as 
number of pixels in longnudinal and lateral darec- 
tons; 

an amplitude measuring drcuU for measuring an 
an^ntude of the input in»ge data fbr every pixel 
block; 40 
a mixing ratio determining circuit for determining for 
every pixel block a mixing ratk) between the input 
image data and the electronic watermarking infor- 
mation t>ased upon a relationship between the val- 
ues of the anvMltudeB measured for every pixel 45 
block: and 

a mixing device for mixing the irput Image data with 
the electronic watermarking information based on 
llie mixing ratio determined for every pixel btock. 

so 

[001 1 } According to a second aspect of the present 
invention, there is provided an electronic watermark 
inserting appanatus for embedding afbrtrary electronic 
watermarking informatfon into a still Image or a mowig 
picturei characterized by comprising: bs 

a block dividing circuit for dividing input Image data 
into a plurality of pixel btocks on a display screen. 



the Woes secHoning the screen in unit of a certain 
number of pixels in longitudinal and lateral direc- 
tions; 

a frequency cNiracteristic measuring drcint for 
measuring a frequency characteristic of the input 
image data; 

a mixing ratio determining circuit for determining for 
every pixel block e mixing r^n between the input 
image data and the electronic watermarking infor- 
mation based upon the frequency characteristic 
measured for every pixel block and 
a mixing device for nvxing the ii^t image data with 
the electronic waiermarHing information based on 
the mixing ratio determined for every pixel bfock. 

[0012] According to a thinj aspect of the present 
invention, there is provided an electronic watermark 
insert'ng method fbr embedding arbitrary electronic 
watermarking information Into a still image or a moving 
picture* characterized by comprising the steps of: 

dividing input image data into a plurality of pixel 
blocks on a display screen, the blocs sectioning the 
screen in unit of a certain number of pixels in longi- 
tudinal and lateral directions 
measuring an amplitude of the input Image data for 
every pixel block; 

determining for every pixel K>l0Gk a rrixing ratio 
between the input image data and the electronic 
watermarking information based upon a relatkin- 
shlp between the values of the amplitudee maaa- 
gred for every pixel block; and 
mixing the input image data with the etectronk; 
watermarking information based on the mixing ratio 
determined for every pixel bkxHi. 

10013] According to a fourth aspect of the present 
inventfon, there is provkled an electronic watermark 
inserting method for embedding arbitrary electronic 
wato-marking Information into a still image or a m^ng 
piclurep characterized by comprising the steps of! 

dividing input image data into a plurality of pixel 
btocks on a display screen, the bfocs secttoning the 
screen in unit of a certain number of pbeeis in longi- 
tudinal and lateral dlrectionB; 
measuring a frequency characteristio of the input 
Image data; 

determinfng for every pixel bfock a mbdng ratio 
between the Iriput Image data and the electronic 
watermarking information based ipon the fre- 
quency chamcteristic measured for every the pixel 
block; and 

mbdng the input image data with the electronic 
watermarMng information based on the mixing ratfo 
determined for every pixel block. 

[0014] In tiie electronic watermark inserting appa- 
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ratus and method of the preGent invention, the input 
imagd data is subdivided into the image blocks and the 
data characteristic of either the frequency characteristic 
or the amplitudG Is measured for every block while keep- 
ing the divided image data in the temporal region, and s 
the mbdng ratio of the electronic watermarldng informa- 
tionlo the image data is determined for every image 
data of each dividad block. Ab a resutt. the electronic 
watermark inserting apparatus and inserting method 
can be made simple, eliminating the need for the com- io 
plex discrete cosine conversion and ateo the complex 
inverse diecrete cosine converston. 
[0015] Preferably, the flrequency characteristic 
measuring circuit for me^uring the frequency charac- 
teristic of the image <fata may include a first filter group tff 
for measuring a frequency characteristic of the pixel 
blodc alorig the horirontal direction, and a second filter 
group for measuring a frequency ctiaracterisHc of tlie 
pixel block atong «ie vertrtal direction, and each of the 
firet filter group and the second filter 9014) owns a so 
band-pass filter having a central frequency at a fre- 
quent related to a sampling frequerwy along the hori- 
zontal direcfion and a eampiing frequency along the 
vertiGal direction, respecflvely. 
[0016] This band-pass fitter comprises comblna- 
tlons of multiplying elements, adding elements, and 
delay elements In an anakig circuit. When the cut-off 
frequency characteristic of this bandi^aes filter is made 
Sharp, a total number of these element combtnatnnG is 
Increased. However, a digital filler circuit may be real- 90 
ized by actually performing a bit shift instead of a multi- 
plication, if 1/2, 1/4. 1/8, and numerals obtained by 
multiplying these values by an Integer are used as a 
multiplier of a multiplying circuit. In this case, since the 
bit shift is contpleted by merely shifting connecttons of 35 
wiring lines, a confilex multiplying circuit is no longer 
required, and also, the digital filter circuit mscf be consti- 
tuted by employing only an adder drcuK and a delay ete- 
rnenL Therefore, although a total number of data 
cateulalions is the same, the circuit scale of the band- 4o 
pass fitter can be greaHy reduced. 



BRIF nPRI^RIPTIQM OF THE DRAWINGS 

[0017] For a better understanding of the present 
invention, reference is made of a detailed description to 
be read in oonjunctfon with the accompanying drawings, 
inwfilch: 

FIG. 1 is a schematfo blod< diagram showing an 
arrangement of an electronic watermark inaerttng 
apparatus according to an embodiment of the 
present invention; 

FIG. 2 is a flow chart illustrating electronic water- 
mark inserting operation t>y the electronic water- 
mark inserting apparatus shown in FIG. 1; 
FK3. 3 is a graph illustrating a gain characteristic of 
a BPF (band-pass filter) of a first group within a 



4€ 



60 



BPF group shown In FIG. 1 : 
FIG. 4 is a graph illustrating a gain characteristic of 
a BPF (bend-pass filter) of a second group within 
the BPF group shown in FIG. 1; 
FIG. 5 is a schematic bkDCk diagram shwnng the 
signal processing drcurt oonlainlnfl a conventtonal 
electronic watermark inserting apparatus; and 
Fia 6 Is a schematic block diagram showing a con- 
ventional electronic watermarking Information 
detecting apparatus. 

nPTAII Fn PgSg RIPTlQM OF THE PREFERRgp. 

EMPPDHVigNTg 

IWnSl Relemng now to the drawings, various pre- 
ferred embodiments of the present invenfion will be 
described more in detail. 

^RRA^^GEME^^ ^ FLPCTRQNin watermark 

IM^gfmi^G APPARATUS 

[001 9] FIG. 1 achematlcany shows an anangemenl 
of an electronic watermark inserting apparatus accord- 
ing to a first embodiment of the present invention. Refer- 
ring to FIQ. 1. this electronte watemfiark inserting 
apparatus is comprised of an input circuit (A/D con- 
verter) 1 1 for Inputting analog input Image data and for 
converting this analog input image data Into digital 
image data; a block dividing unit 1 2 tor entering the (*g- 
Hal image data and for dividing this input digital image 
data Into pixel bSocks each consisting of 8 (in wkith) x 6 
(|n length) pbcele on a display screen; and a band-pass 
filter (BPF) ^oup 1 3 for filtering out a pli^aSty of specific 
frequencies along both the longitudinal direction and the 
lateral direction from the digital image data of each of 
these pixel blod<6. The elecbnonk; watermark inserting 
appamtue further oomprisea a spectrum measuring ixiit 
14 for nf>easuring a spectrum strength of each of these 
specific frequency components outputled from the BPF 
group 13; an amplitude measuring circuit 15 for measur- 
ing amplitudes of the digital image data afong the longi- 
tudinal direction and tiie lateral direction, outputted from 
the block dividing unit 12; a mbdng ratio determining unit 
1 6 for determining for every pixel block a mixing ratio of 
the digital image data to electronic watermarking Infor- 
mation based upon the spectrum strength output of the 
spectrum measuring unit U and the arrplrtude outputs 
of the amplitude measuring unit 1 5; an eiectronic water- 
mark mixing unit 17 fbr superimposing the ele^ronic 
watermarlcng information on the digital imaQe data 
based upon tiie mixing ratio determined fbr e^ery bfock; 
an electronic watermaric memory 18 for storing elec- 
tronic watermarking informatfon to be superimposed; 
and an output circuit (D/A converter) 19 for converting 
the digital Image data outputted from the electronic 
watermark mixing unit 17 Into an analog signal to pro- 
duce reproduction data. 

(0020] Generally speaking, whan eiectronic water- 
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marWng information is stperimposed on an in^ge sig- 
nal, a deterioration occurs In an original imaga As a 
human eye chaiacteristic. when an electronw water- 
mark and the like are embedded as noise into an image 
whose frequency is constant, or low, this may be easily 
recognized as an Image deterioration, When electronic 
watemiarldng intormalion is inserted into a straight- 
lined edge, or an arc since these lines are changed to 
have a zig-^ag form, this may also be readily recognized 
as an Image deterioration. As a result, in the case that 
electronic watermarking information is to be embedded 
into image data, it is required to detect a feature of this 
image data, and then to adjust a mixing ratio of the 
image data to the elactronifi watermarking ink)rmation 
In order not to cause such an Image deterioration. 

ELECTRONIC WATERMARK INSEFTINQ PROCESS 
OPERATION 

[0021] PIO. 2 is a flow chart illustrating an electronic 
watermark inserting process operation executed by the 
above-described electronic watermark inserting appa- 
ratus according to the first errtxximent. In the process 
performed by the electrode watermark inserting appa- 
ratus and shown in FIG, 2, input image data is fret A/D- 
converted by the input circuit n at a step Si . Nojct this 
digital input image data is sitodMded irtto a plurality of 
digital image data in the unit of a block by using the 
block dividing unit 12 at a step S2. The block dividing 
unit 1 2 divkJes the data Inta tor example, 5400 pi eces of 
data when the data is of a television image having 720 x 
480 pixels in a single screen and one block consists of 
8x8 pixels, "men, at a step S3, the image data of each 
Of these subdivided bk)cks is filtered by the BPF group 
Id so as to eoctract a frequency component from each of 
the subdivided btocta. 

[0022] FK3. 3 shows a gain charactarisfic of BPF 
(corrtaining LPF) of a first group contained in the BPF 
group 13 and employed to extract a frequency along the 
horizontal dredion, and FIG. 4 shows a gain character- 
istk: of BPF of a second group included in the BPF 
group 1 3 and used to extract a frequency along the ver- 
tical direction. In FIG. 3. the BPF of the f iiSt group for 
extractir^ the frequency along the horizontal direction 
corresponds to a set of BPF 5 to BPF 1, which are 
obtained using half the horizontal sampling frequency in 
the MPEG system of 13.5 MHz as a reference fre- 
quency. These BPF 5 to BPF 1 own as central frequen- 
cies. 6.75 MHz: 5.06 MHz (3.375+1.69 MHz): 3.375 
MHz: 1.69 MHz; and 0 MHz, respectively. A bandwidth 
of each of the BPF 5 to BPFl is * 0.5MHz from the cen- 
tral frequencies thereof. In FIG. 4, the BPF (including 
LPF) of the second group for extracting the frequency 
along the vertical direotton corresponds to a set of BPF 
10 to BPF 6. which are obtc^ned using half the scanning 
frequency in the vertical direction of 15.75 KHz as a ref- 
erence frequency. These BPF 10 to BPF 6 own as cen- 
tral frequencies. 7.87 KHz: 5.90 KHz (3.93 + 1 .97 KHz); 



3.93 KHz: 1,97 KHz: and 0 KHz, respectively. A band- 
width Of each of the BPF 1 0 to BPF6 is ± 0.68 KHz from 
the central f requendee thereof. At a step S3, this filter 
group 13 is enptoyed so as to extract the respedivefre- 
5 quency componerns which te acquired while the btock 
image date are sequentially outputied along the hori- 
zontal direction and the vertical direction. 
[0023) NexL at a step S4. the spectrum measuring 
uhit 1 4 extracts a spectrum amount with respect to each 
10 of the frequency components. In other words, the spec- 
trum strengths of the respective frequency components 
extracted at the previous step 53 are measured. 
[0024] Next, at a step S5, the amplitude measuring 
unit 15 detects an amplitude of the original image data 
IS and ^0 a changing characterlstk; thereof. 

[0025] Subsequerrtly, a check ia made at a step S6 
on the magnitude of this detected amplitude. When the 
amplitude Is small, namely when the image is dark. arwJ 
when the amplitude is large, namely when the Image is 
20 light, ance the electronic watermarking infomnalion can 
be hardly obaerved. the mixing ratio of the electronic 
watermaiKing Infbrmalton to the image data la set to a 
large value (step S7). Also, in the case that the ampli- 
tude judged at the step S6 is an approximately medium 
25 value, human eyes can recognize ttiis intermediate fre- 
quency very well, hiow^er. since the mixing ratio is 
changed depending on the magnitude of frequenoy 
components of the electronic watermarWng information, 
the mixing ratio may be determined based upon the fre- 
30 quency characteristic as foUows; 

[PQ261 At a Step S8. the mixing rafio determining 
unit 16 first judges as to whether or not the image data 
of each of these subdivided blocks along the tongituili- 
nal direction and the lateral direction mns a peak at a 
» frequency in the vicinity of the frequency of the elec- 
tronio waiernmrking information. In such a case that the 
image data of each of the subdivided blocks along the 
longitudinal directkin and the lateral direction owns a 
large spectrum strength at the frequenoy near the fire- 
40 quency of the electronic watenmarking infomtation, 
since tfie electronic watermarking information Is hidden 
under the Image data, the mixing ratio determining unit 
1 6 sets the mixing ratio to a laige value (step S9). At the 
previous step Sa. when the image data of the respective 
45 blocks own such frequency characteristics greatly differ- 
ent from the electronic watermarking informatton, the 
mixing ratio determining unit 1 6 judges as to whether or 
not a vectrum amount at a h^h frequency range por- 
imn of each of the block image data is large (step Sio). 
60 In this case, when the block Image data owns a rela- 
tively small spectaim at the high frequency range por- 
tion, this mixing ratio determining unit 1 6 sets the mfadng 
imtio to a small value (step S1 1). Conversely, when the 
bk>ck image data owns a large spectrum at the high fre- 
£s ' quency range portion, the mixing ratio determining unit 
16 sets the nrdxing ratio to a medium value (step S12). 
Thereafter, in any case, the electronic watermarking 
infbrmatkm is superimposed on the image data baaed 
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upon the determined mixing ratio in the electronic 
watermark mixing unit 19. 

IVlODlFICMlOriS 

[0Q27] In flenerai^ a mixing ratio of an electronic 
watermarK ie eet in a range of between 0 and 1 with 
reepoct to the input image data 100 of each of the 
Wocte- When an amplitude of image data is large, 
namely this inrtage is light and an amplitude of image 
data is small, namely thie image is darl^ since electronic 
watarniarking information can be hardly observed, a 
mixing ratio of the electronic watermarking information 
to the image data is set to a large value. However, in 
such a case that an amplitude of image data is an inter- 
mediate level, human eyes can recognize this image 
data very well, so that the eledronte watermerWng infor- 
mation can be readily obsen/ed. As a result, the mixing 
ratio of the electronic watermarlong information is set to 
be a small value. Alsa in the case that an arTpHtude of 
irnage data is an intermediate level and furthermore this 
image data contains a small amount of the same fre- 
quency components, although the electrons water- 
marldng information can be easily observed, if the 
frequency of the Image data is separated from the fre- 
quency of the electronic watennarking infomiation, then 
this electroric watermarking information can be hardly 
observed. As a consequence, this electronic water- 
marking infbrmation may be inserted Into the image 
data to some extent. In any cases, the mixing ratio may 
be preferably determined based upon both the ampli- 
tude characteristic and the frequency characteristic, 
while the electronic waiem>arWng bifprmatton can be 
hardly observed. 

[0028] Ab the electronic watermarking Information 
stored in the electronic watermark memory 18. for 
instance, electroric watenvmrking inlbmiatlon displayed 
on an ertlire scteen. or electronic wotermarMno infor- 
mation dffiplayed only on a predetermined screen por- 
tton may be emptoyed. Furthermore, such electronic 
watermarking information may be en>pioyed which is 
Inserted mto only an innage data biock having an ampli- 
tude equal to or higher than a preselected amplitude 
level at a specific frequency. 
[0029] In the above-described embodiment^ after 
the amplitude of the image data is judged at the step S6. 
the mixing ratio determining unit 16 detects as to 
whether or not the same frequency components are 
large at the step S6. Alternatively, the process opera- 
ttons executed at these steps S6 and S8 may be carried 
out in the reverse order. 

[0030] In the atove-axplained embodiment, the 
desaiption is given «tth respect to the example in which 
the misdng ratio Is determined based on the frequency 
characteristic and by checMng the multitude of the 
anplltude on the irYiage data, but the present Invention 
is not United thereto. Alternatively, instead of this fre- 
quency characterlstk:, fbr example, the mixing ratio may 



be determined by detecting a changing characteristic of 
a frequency chamctsrlstic. namely by checWng such a 
characterifetkJ indicating how a spectnim amount along 
either the longitudinal directfon or the lateral directkan 
s changes. 

In this alternative case, if the frequency 
change becomes large, then the eledrortic watermark^ 
ing intomiation can be hardly observed. As a conse- 
quence, the mixing ratio is set to a large value, 
fo Alternatively, the mixing ratio may be determined m 
acooixlance wHh only the amplitude and/or the anpii- 
tude change. Furthermore, the mixing ratio may be 
determined based only on the frequency characteristic. 
[00921 Also, with respect to the frequency charac- 
16 teristio measuring circurt for measuring the frequency 
characteristic of the Image data, there are provided the 
first filter group and the second filter group. The first la- 
ter group measures the frequency characteristic of the 
pixel block atong the horizontal direction. The seoondfil- 
20 ter grow measures the frequency characteristic of the 
abov»l66cribed pixel block along the vertical directton. 
Each of the first fitter group and the second fitter group 
is constiluted by such a band-pass filters having the 
central frequencies located at frequencies related to 
25 both the sampling frequency in the horizontal direction, 
and stfso the sampling frequency in the vertical direc- 
tion. 

10033] This band-pass filer conurlses combina- 
tions of multiplying elemente, adcfing elements, and 
$0 d^€(y elements with each other When the cut-off fre- 
quency characteristic of this bandi>ass filter Is nade 
sharp, a total number of these element combinattons is 
increased. However, a digital filter circuit may be real- 
ized actually by performing a bit shift instead of a nuitl- 
$$ plication, iff 1/2. 1/4. 1/B. and numerals obtained by 
multiplying these values by an integer are used ae a 
muitipllar of a multiplying circuit. In this case, since the 
bit shW is completed by merely shifting connections of 
wiring lines, a complex mulling circuit is no bnger 
40 required, and also, the digital filter circuit may be owisti- 
tuted \yf employing only a bit shift circuit, an adder cir- 
cuit, and a delay element Therefore, although a total 
nurnber of data calculations is the same, the circtjit 
scale of the band-pass filter can be greatly reduced. 
45 10034] While the present invention has been 
described in accordance with the above^alned pre- 
ferred en4)odiments, the electronio watermark inserting 
method and apparatus of the present invention are not 
limited to the arrangements of these preferred embodi- 
S6 ments. but may be modified, changed, and substitutad 
without departing f^om the technical spirit and scope off 
the present irrvention. 

[q035] In the eSectronic watermark inserting appa- 
ratus of the present invention, the input image data is 
ss subdivided Into the respective blocks and either the fre- 
quency characteristic or the amplitude is obtained while 
keeping the temporal region, and the mixing ratio of the 
electronk) watermarking infbrnnation to the image data 
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id detenrwned without changing the imago data into the 
spatial frequency region. a result, there ie such an 
effect that the electronic watermark inaerting apparatus 
and inserting method can be made eimple, eliminating 
the need for the complex discrete cosine conversion 
and also the complex Inverse discrete cosine conwer- 



aaims 



An electronic watennark inserting apparatus for 
embedding arbitrary electronic watermarking intor- 
mation into a still image or a moving picture, com- 
prieing: 

a block dividing circuit for dividing input inrtage 
data into a plurality of pixel bipcks on a display 
screen, the bloca sectioning the screen In unit 
of a certain number of pixels In longitudinal and 
lateral directions; 

an arTf}litucie measuring circuit tor measuring 
an amplitude of the input image data for every 
pixel block; 

a mixing ratio determining circuit Ibr determin- 
ing ^ every pixel block a mixing ratio between 
the input image data and the electronic water- 
marking information based upon a relationship 
between the values of the ampiaudee meas- 
ured for every pixel block; and 
a mbdng devtoe for mixing the input image data 
witii the electronic watermarking informatkNi 
based on tiie mDdng ratio determined fbr every 
pixel block. 

eledronio watermark niserting apparatus fbr 
embedding arto'rfrary dectronio watermarking infor- 
mation into a still image or a moving picture, com- 
prising: 

a block divkiing circuit for divfdir>g input image 
data into a plurality of pixel Uocte on a display 
saeen. tiie blocs sectioning the screen in unit 
of a certain number of pixels in longitudinal and 
lateral directions; 

a frequency characteristic measuring circuit fbr 
measuring a frequency characteristic of the 
Input image data; 

a mixing ratio determbiing circuit for determin- 
ing fbr every pixel blodc a mixing ratio between 
the input image data and the electronic water- 
marking information based upon the frequency 
characteristic measured Ibr avary pixel blodc 
arxj 

a ntixing device tor mixing the ir>put image data 
with the electronic watermarking Information 
based on the mixing ratio detern^ed for every 
pixel btock. 



3, An electiOTic watermark Inserting apparatus as 
claimBd in claim 2, furtiier comprising ari amplitude 
measuring dncuH tor measuring an artipiitude of the 
input image data fbr every pbcel block, wherein tii© 
5 miwng ratio determining circuit detemnines the mix- 
ing rmio based i^n tfie frequency characteristic of 
each pixel block and the measured amplitude 
arei/or a variatnn contained in tifie amplitudes. 

70 4. An electronic watermark Inserting apparatus as 
daimed in claim 2 wherein: 

said frequency characteristic measuring circuit 
includes a first filter group fbr measuring a fre- 
1$ quency characteristic of the pixel block along 

the horizontal direction, and a second filter 
group tor measuring a frequency characteristic 
of tiie pixel block akxig tiie vertical direction; 
and 

so each of said f ^st filter group and said second 

filter groip owns a band-pass filter having a 
central frequency at a frequency related to a 
sampling frequency along the horlzontel direc- 
tion and a sampling frequency along the verti- 
£6 cal direction, respedivaly. 

$. An electronic watermark inserting apparatus as 
claimed in claim 3 wherein: 

go sM frequency characteristic measurirrg circuit 

includes a first filter group for measuring a fre- 
quency characteristic of the pixel block along 
the horizonta] direction, and a second filter 
group for measuring a frequency characteristic 
ss of the pixel blodk along the vertical direction: 

and 

each of said first filter group and saki second 
filter group owns a band-pass titer having a 
central frequency at a frequency related to a 
40 sampling frequency along the horizontal direc- 

tion and a sanding frequency along tiie verti- 
cal direction, respediveiy. 

6. An electronic watermark Inserting method fbr 
45 embedding arl^ary electronic watermarlsng infor- 
mation into a still image or a nxDving picture, com- 
prising: 

dividing input image data Into a plurality of pixel 
60 blocks on a display screen, the blocs sectioning 

the screen in unit of a certain number of pixels 
in longitudinal and lateral directions 
measuring an ampTitude of tiie Input image 
data for every pixel btock; 
sd determining for every pixel block a fnixing ratio 

between the input image data and the elec- 
tronic watermarking informaiton based upon a 
relationship tMlween the values of the ampli- 
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tudesmoa6uredtore.«rypix»lbtock;and ' frequency along the verticaldir^oa 

mixing the input image data with the electronic 
watermarking Intomnalion baeed on the mijdnfl 
ratio determinecl tor every pixel bfock. 

s 

7. An electronic watermark inserting method for 
err^edding art)itrary electronic watermarking infor- 
mation into a still image or a moving picture, com- 
prlaing: 



10 



dividing input image data into a plurality ot pixel 
blocks on a display screen, the blocs eeaioning 
the screen In unit of a certain number of pixels 
in longitudinal and lateral directionfi; 
measuring a frequency characteristio of the is 
input image data; 

determining Ibr e\^ery pixel WocK a mixing ratk) 
betws^ the input image data and the elec- 
tronic watermarteng Information based i^ion 
the frequency characteristic measured fbr so 
every the pixel block; and 
mixing the input image data whh the electronic 
watermarking Information baBed on the mixing 
ratio determined for e^ry pixel block. 



29 



8. An electronic watermark inserting method as 
claimed in dalm 7, further comprising measuring 
an anplitude of the Irfjut image data for every pixel 
block, wherein the mixing ratio detemrwning step 
detenfhines the mixing rstte based upon the fre- so 
quency characteristic of each pixel block and the 
measured ampTrtude and^or a variation contained in 
theanvlltudea. 

9, An electronic watermark inserting method as 9$ 
claimed in claim 7 wherein: 



the frequency characteristic measuring step 
measures the frequency diaraoteristio of the 
pixel blGd< along the horizontal direction based 40 
iq)on a frequency corresponding to a sanpiing 
frequency of the horizontal direction, and 
measures the frequency characteristic of the 
pixel block along the vertical direction based 
upon a frequency corresponding to a sampling 4$ 
frequency along the vertical directwn. 

10. An electronic watermark inserting method as 
claimed in claim d wherein: 

60 

the frequency characteristic measuring step 
measures the frequency charactaristio of the 
pixel block along the horizontal direction based 
upon a frequency con'esponding to a sampling 
frequency of the horizontal directkin. and 59 
measures the frequency characteristic of the 
pixel tiock along the vertical direction tmsed 
upon a frequency con'espondlrtg to a sampling 
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